Appl. No. : 09/300,798 

Filed : April 27, 1999 

REMARKS 

Procedural History 

Claims 1-17 are pending in the application. Claims 1-17 have been rejected. Claims 18 - 
20 are new. 

Response to Rejection of Claims 1-17 

In the Office Action, the Examiner rejected Claims 1-17 under 35 U.S.C. § 103(a) as 
being unpatentable over Frederick, U.S. Patent No. 5,768,126 in view of Kondo, U.S. Patent No. 
5,952,596 (The '596 patent"). The c 596 patent was filed in the U.S. on Sept 15, 1998. 

Without agreeing with the Examiner's rejection of Claims 1 - 17 under 
35 U.S.C. § 103(a), Applicant submits herewith a Declaration under 35 C.F.R. § 1.131 (the 
"Declaration") establishing inventorship in the United States prior to the effective date of the 
'596 patent. 

The Declaration is that of Kenneth E. Cooke, the named inventor, and includes a 
Declaration of Rahul Agarwal (Exhibit 1), an assistant to the inventor on the present application. 
The Declaration, Exhibit 1 and Appendices A, B and C attached thereto demonstrate Applicant's 
reduction to practice of independent Claims prior to the January 15, 1998 effective date of the 
Jones patent. Therefore, Applicant respectfully submits that Claims 1-17 should now be in 
condition for allowance. 

The Examiner is respectfully invited to contact the undersigned should any additional 
information be required. 

New Claims 18 - 20 

Applicant has added Claims 18-20, which depend from Claim 1, 7 and 17. Because 
Claim 1,7 & 17 and the other rejected claims should now be allowable in view of the § 1.131 
Declaration, Applicant submits that Claims 18-20, as dependent claims, should likewise be 
allowable. 
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Summary 

Applicant respectfully requests the Examiner to withdraw the rejection to Claims 1-17 
under 35 U.S.C. § 103(a), to allow Claims 18-20, and to pass the present application to 
issuance. 

Should there be any remaining impediments, questions or issues, the Examiner is invited 
to contact Douglas G. Muehlhauser, the attorney of record at (949) 721-2994 (direct dial) or at 
the general office telephone number listed below. 

Respectfully submitted, 

KNOBBE, MARTENS, OLSON & BEAR, LLP 
Dated: November 22, 2002 By: 



Robert J/koby 
Registration No. 44,3 
Attorney of Record 
2040 Main Street 
Fourteenth Floor 
Irvine, CA 92614 
(949) 760-0404 
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Appendix A 

/*****************************************************^ 
********** 

RECEIVED 

* 
* 



NOV 2 9 2002 

ressive Networks. j ec j 

* All rights reserved, 



* Copyright (C) Progressive Networks. Technology Center 2000 



* 

* Fixed-point crossfade. 

* Uses arbitrary lookup table, with table interpolation, 
* 

* Ken Cooke 
*/ 

#include <stdio . h> 
#include <math.h> 
#include "pnresult . h" 
#include "pntypes .h n 
#include "pnassert . h" 

#include "crosf ade . h" 

# include "pnheap ,h M 
#ifdef _DEBUG 
#undef PN_THIS_FILE 

static char PN_THIS_FILE [] = FILE ; 

#endif 

//#define GENERATE_TABLE 1 
#define TABLE FILE NAME " table. cpp" 



CrossFader: : CrossFader ( ) 

: tabstep(O) 

, tabacc(O) 

, tabint(O) 

, m_uNumChannel s ( 0 ) 

, m_blnitialized (FALSE) 

{ 
} 



CrossFader: : -CrossFader ( ) 

{ 

} . 



PN RESULT 
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CrossFader: : Initialize (UINT16 uNumSamplesToFadeOn, UINT16 uNumChann 
els) 

PN__ASSERT (uNumSamplesToFadeOn > 0 && uNumChannels > 0) ; 
if (uNumSamplesToFadeOn = = 0 | | uNumChannels == 0) 

{ 

return PNR_INVALID_PARAMETER; 

} 

tabacc =0; /* accumulator */ 

tabint =0; /* table index */ 

tabstep = (NALPHA << FRACBITS) / uNumSamplesToFadeOn; 

m_uNumChannels = uNumChannels; 
m_blnitialized = TRUE; 

return PNRJDK; 

} 

/* 

* Crossfades over nfade samples, operating in-place on sampnew. 

* alpha values are generated from table via linear interpolation. 

*/ 
void 

CrossFader : :CrossFade (INT16* sampold, INT16* sampnew, UINT16 uNumSa 
mples) 

{ 

INT32 alerp, sdelta; 
UINT16 n; 

if ( !m_blnitialized) 

{ 

return; 

} 

/* crossfade, stepping thru table in fixed point */ 
for (n = 0; n < uNumSamples; n+ + ) 

{ 

/* interpolate new alpha */ 
alerp = alpha [tabint] ; 

alerp += (adelta [tabint ] * (tabacc & FRACMASK) ) » FRACBITS 

/* next table step */ 

tabacc += tabstep; 

tabint = tabacc >> FRACBITS; 

for (UINT16 uNumChannels = 0; uNumChannels < m_uNumChannels 
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; uNumChannels++) 
{ 

/* crossfade, using interpolated alpha */ 

sdelta = alerp * (*sampold - *sampnew) ; 

*sampnew += int ( (sdelta + FRACROUND) >> FRACBITS) ; 

sampold++ ; 
sampnew++ ; 

} 

} 

} 



/* 

* Initialize crossfade tables. 

* Currently using linear dB, but could be anything. . . 

* This code is ONLY used to generate static tables. 

*/ 

void 

CrossFader: : CrossFadelnit (void) 

{ 

double dbval, dbstep; 
int n; 

#ifdef GENERATE_TABLE 

FILE* fd = f open (TABLE_FILE_NAME , "w+" ); 

fprintf(fd, "static INT32 alpha [NALPHA+1] = {\n") ; 

fprintf(fd, "\n\t\t\t\t " ) ; 
#endif / * GENERATE_TABLE * / 

/* generate alpha table */ 

dbstep = (DBEND - DBS TART) / (NALPHA - 1) ; 
for (n = 0; n < NALPHA; n++) 

{ 

/* linear steps in dB */ 

dbval = DBS TART + (dbstep * n) ; 

/* store as gains, in fixed point */ 

alpha [n] = (int) (DB2GAIN (dbval) * (1<<FRACBITS) +0.5) 

#ifdef GENERATE_TABLE 

f print f(fd, "%d, ", alpha [n] ) ; 
if ( (n+1) % 5 == 0) 

{ 

fprintf(fd, "\n\t\t\t\t " ) ; 

} 

#endif / * GENERATE_TABLE * / 
} 
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alpha [n] = alpha [n-1] ; 



/* in case roundoff oversteps 



#ifdef GENERATE_TABLE 

fprintf(fd, "%d\n", alpha [n] ) ; 
fprintf(fd, "};\n\n"); 

fprintf(fd, "static INT32 adelta [NALPHA] = {\n") ; 
fprintf(fd, "\n\t\t\t\t") ; 
#endif / *GENERATE_TABLE* / 

/* generate delta table, for fast interpolate */ 
for (n = 0; n < NALPHA- 1 ; n++) 



adelta [n] = alpha [n+1] - alpha [n] ; 



#ifdef GENERATE_TABLE 

fprintf(fd, "%d, ", adelta [n] ) ; 
if ( (n+1) %5 == 0) 



#ifdef GENERATE_TABLE 

fprintf(fd, "%d\n" , adelta [n] ) ; 

fprintf(fd, "};\n\n"); 

f close (fd) ; 
#endif / *GENERATE_TABLE* / 



/* 

* test app 
*/ 

#ifdef GENERATE_TABLE 

#define NMAX 4096 
short testold [NMAX] ; 
short testnew [NMAX] ; 
int 

main (void) 



int n; 

for (n = 0; n < NMAX; n++) { 



fprintf(fd, "\n\t\t\t\t " ) ; 



#endif 



/ * GENERATE TABLE * / 



adelta [n] = 0; 



/* in case roundoff oversteps */ 
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testoldfn] = -32768; 
testnew[n] = 32767; 

} 

CrossFadelnit () ; 

CrossFade (testold, testnew, 1024) ; 
return 0 ; 

} 

#endif / * GENERATE TABLE*/ 
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w RECEIVED 
NOV 2 9 2002 
Technology Center 2600 

/************************************** 
********** 

* pnaustr.cpp 
* 

* Copyright (C) Progressive Networks. 

* All rights reserved. 
* 

* Progressive Networks Confidential and Proprietary information. 

* Do not redistribute. 
* 

* PN implementation of Audio Stream Interface. 
* 

* 

*/ 

#include <stdio . h> 
#include <string . h> 




#include 
#include 

#include 
#include 
#include 
#include 
#include 

#include 
#include 
#include 
#include 
#include 
#include 

#include 
#include 
#include 

#include 

#include 
#include 
#include 



"pnresult . h" 
'pntypes .h" 

'pncom. h" 
•rmaengin . h" 
'rmapckts . h" 
" rmaausvc . h" 
'rmarasyn . h" 

'pnpckts . h" 
'pnaudstr . h" 
'pnaudply .h" 
'pnaudses .h" 
'pnmixer .h" 
'pnaudvol .h" 

'pnslist .h" 
'pnmap . h n 
auderrs . h" 

'pntick . h" 

resample . h" 
1 interp . h" 
'crosf ade . h" 



// for IRMAVolume 



// for resampler 

// for Linear Interpolator 
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/******************* *********************** ************************ 
****** 

* Method: 

* CPNAudioStream: : MixIntoBuf f er 

* Purpose : 

* Mix stream data into this pPlayerBuf . 

* Note: 
* 

* Resampler always works on 16 bit PCM. If the input is 

* 8 bit, it converts it first to 16 bit before making 

* any resampling calculations. 

* We always try to open audio device in 16 bit stereo mode. 

* This is because a new player/stream may be instantiated in 
the 

* midst of a presentation and this new stream may be stereo. 
If we 

* earlier opened the device as mono, we will have to force th 
is stereo 

* stream to be played as mono! Not a good idea. Also any mono 
-streo 

* conversion almost comes for free (some extra memory usage a 
nd 

* an extra assignment) since it can be done in the mixing loo 
p in 

* MixBufferO . 
* 

* Any 8-16 and stereo-mono conversion, if required, SHOULD be 
done 

* before resampling . 

* Any mono- stereo conversion should be done after resampling. 
* 

. * Stereo-Mono conversion code resides in the resampler. 

* Mono-Stereo conversion code resides in the mixer. 
* 

*/ 

PN_RESULT CPNAudioStream: : MixIntoBuf f er 
( 

UCHAR* pPlayerBuf, 

ULONG32 ulBufSize, 

ULONG32& ulBufTime, 

BOOL bCalledFromAudioThread, 

BOOL bGetCrossFadeData 

) 
{ 

BOOL bCrossFadeThisTime = FALSE; 

UINT32 ulTimeActuallyFaded = m_ulGranularity ; 
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if ( !m_blnited) 
{ 

return PNR_NOT_INITIALIZED; 

} 

//{FILE* fl = : rfopen ("c: \\tempWrasync.txt", "a+"); : : fprintf (f 1 , 
"Call MixIntoBuf fer : %lu\n M , m_ulLastWriteTime) ;:: f close (fl) ; } 
/* If this is a *FROM* stream, we may have already mixed 

* data during cross-fade with *T0* stream 
*/ 

if (m_bFadeAlreadyDone && !m_bFadeToThisStream) 

{ 

m_bFadeAlreadyDone = FALSE; 
return PNR_OK; 

} 

PN_ASSERT ( IbGetCrossFadeData | | !m_bFadeToThisStream) ; 

/* If we need to mix cross fade data from the *from* stream, 

* it better be available 
*/ 

PN_ASSERT( IbGetCrossFadeData || m_pDataList->GetCount () > 0) ; 

/* If this stream needs to be cross-faded and is a 

* NOT a fade-to stream, it would have been already taken 

* care of by the fade-to stream in an earlier call to 

* MixIntoBuf fer () 
*/ 

if (m_bCrossFadingToBeDone && m__pDataList- >GetCount ( ) > 0) 

{ 

PNAudioInfo* plnfo = (PNAudioInf o* ) m_pDataList->GetHead() 
UINT32 ulStartTime = 0; 
if (plnfo) 

{ 

ulStartTime = plnfo- >ulStartTime + 

CalcMs (plnfo- >pBuf f er- >GetSize ( ) - 
plnfo- >ulBytesLeft) ; 
if (m_bFadeToThisStream) 

{ 

/* Cool! It is time for cross-fading */ 
if ( (m_ulLastWriteTime <= m_ulCrossFadeStartTime & 
m_ulCrossFadeStartTime - m_ulLastWriteTime <= 

_ulGranularity) | | 

m_ulLastWriteTime > m_ulCrossFadeStartTime && 
m_ulLastWriteTime - m_ulCrossFadeStartTime <= 

ul Fudge) 

{ 

bCrossFadeThisTime = TRUE; 
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if (m ulLastWriteTime <= m_ulCrossFadeStartTime 



ulTimeActuallyFaded = m_ulGranularity - 

(m ulCrossFadeStartTime - m ulLastWrite 



Time) ; 



} 



//{FILE* fl = : :fopen("c:\\raroot\\racross.txt", "a+ ,f ); ::fprintf(f 
1, M m_ulLastWriteTime : %lu ulStartTime: %lu rnjalCrossFadeStartTime : 
%lu pInfo->ulStartTime : %lu plnf o->pBuf f er->GetSize ( ) : %lu pInfo-> 
ulBytesLeft: %lu\n" , m_ulLastWriteTime, ulStartTime, m_ulCrossFadeS 
tartTime, plnf o->ulStartTime, pInfo->pBuf f er->GetSize () , pInfo->ulB 
ytesLef t) ; : : fclose (f 1) ; } 

PN_ASSERT ( 

(ulStartTime >= m_ulCrossFadeStartTime && 
(ulStartTime <= m_ulCrossFadeStartTime + 

m_ulCrossFadeDuration) ) | | 
(ulStartTime < m_ulCrossFadeStartTime && 
(m ulCrossFadeStartTime - ulStartTime <= m 



ul Fudge) ) ) 
/ 

#if 0 



lBytesLef t] 

ScSc 



} 

} 

/* We better have enough data available to cross- fade * 
else if (bGetCrossFadeData) 

{ 

RemoveExcessCrossFadeData () ; 

if (m_pDataList->GetCount () > 0) 

{ 

plnfo = (PNAudioInf o*) m_pDataList- >GetHead ( ) ; 
ulStartTime = plnf o- >ulStartTime + 

CalcMs (pInfo->pBuf f er->GetSize '() - pInfo->u 

PN_ASSERT (ulStartTime >= m_ulCrossFadeStartTime 

ulStartTime <= m_ulCrossFadeStartTime + 
m_ulCrossFadeDuration) ; 

} 

else 

{ 



/* We should have data here for cross -fading*/ 
PN ASSERT (FALSE) ; 



#endif 
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} 

if ( IbGetCrossFadeData && ulBufTime < m__ulLastWriteTime) 

{ 

ulBufTime = m_ulLastWriteTime ; 

} 

/* If there are any DryNotif ications and the data list is empty 
* we need to notify them so that they can write more data. 
*/ 

if (m DryNotif icationMap-GetCount () > 0) 

{ 

ULONG32 ulNumMsRequired = m_ulGranularity ; . 
ULONG32 ulLastWriteTime = m_ulLastWriteTime ; 
if (m_pDataList->IsEmpty () | | ! EnoughDataAvailable (ulLastWr 
iteTime, ulNumMsRequired) ) 

{ 

i f ( bCal 1 edFromAudioThread) 

{ 

return PNR_FAI L ; / / PNR_NOT_ENOUGH_DATA ; 

} 

IRMADryNotif ication* pDryNotif ication = 0; 
CPNMapPtrToPtr: : Iterator liter = m_DryNotif icationMap . B 

egin() ; 

for (; liter != rn_DryNotif icat ionMap . End ( ) ; + + llter) 

{ 

pDryNotif ication = (IRMADryNotif ication*) (*llter) ; 
pDryNotif ication- >0nDryNot if ication (ulLastWriteTime 
, ulNumMsRequired) ; 

} 

if (m_Owner->GetState () != E_PLAYING) 
{ 

return PNRJDK; 



// //////////////////////////////////////////////////////////// 

/ 

// There may be no buffers in the list. No packets? Play silenc 

e . 

// Still need to increment time. 

if ( m_pDataList->IsEmpty () && m_pInstantaneousList- >IsEmpty ( ) 

) 

{ 

m ulLastWriteTime += m_ulGranularity ; 
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return PNR NO DATA; 



UCHAR* pSourceBuf fer = 0; 

ULONG32 ulMaxBytes = 0; 

ULONG32 ulMaxFramesIn = 0; 

ULONG32 ulMaxFramesOut = 0; 

ULONG32 ulNumBytesMixed = 0; 

BOOL bMonoToStereoMayBeConverted = TRUE; 



// //////////////////////////////////////////////////////////// 

// If no resampling, mix stream data directly into the player 
// buffer. 

if ( !m_pResampleId && !m_plnterpld) 

{ 

pSourceBuf f er = pPlayerBuf; 
ulMaxBytes = m_ulInputBytesPerGran; 

/* For only those sound cards which do not 
* support stereo - a RARE (non-existent) case 

*/ 

if (m_AudioFmt .uChannels == 2 m_DeviceFmt .uChannels == 1 

{ 

/* We should never reach here since this case 

* should be handled by the Resampler 

* Temporary ASSERT. . . 
*/ 

PN_ASSERT (FALSE) ; 

} 

/* Mono- >Stereo conversion*/ 
else if ( m__bChannel Convert ) 
{ 

PN_ASSERT (ulMaxBytes <= ulBuf Size/2 ) ; 

/* Avoid GPF" in retail builds! */. 
if (ulMaxBytes > ulBuf Size/2) 

{ 

ulMaxBytes = ulBuf Size/2; 

} 

} 

else 
{ 

PN_ASSERT (ulMaxBytes <= ulBufSize) ; 
/* Avoid GPF in retail builds! */ 
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if (ulMaxBytes > ulBufSize) 
{ 

ulMaxBytes = ulBufSize; 

} 

} 

// //////////////////////////////////////////////////////////// 

/ 

// If resampling, mix stream data into a tmp buffer. Then 

// resample this buffer and mix the final resampled buffer into 

// the player buffer. 

else 

{ 

bMonoToStereoMayBeConverted = FALSE; 

memset (m_pTmpResBuf , 0, PN_SAFESIZE_T (m_ulMaxBlockSize) ) ; 
pSourceBuf f er = m__pTmpResBuf ; 

/* 

* Audio Session will always ask for m_ulOutputBytesPerGran 
bytes to be mixed 

* in MixIntoBuf f er ( ) call. So we need to produce these man 
y number of bytes. 

* If there is any mono- stereo conversion that happens in t 
he mixing, number 

* of output bytes required from the resampler are half the 
number of 

* m_ulOutputBytesPerGran bytes. 

*/ 

if (m_pResampleId) 

{ 

ulMaxFramesOut = m_ulOutputBytesPerGran/ (m_DeviceFmt . uB 
itsPerSample==8 ? 1 : 2) ; 

if (m_DeviceFmt .uChannels == 2) 

{ 

ulMaxFramesOut /= 2 ; 

} 



ulMaxFramesIn = ResamplerRequires (ulMaxFramesOut , m__pRe 



sampleld) 



ulMaxBytes = ulMaxFramesIn * ( (m__AudioFmt . uBitsPerSamp 
le==8) ? 1 : 2) 

* m_AudioFmt . uChannels ; 

} 

#ifdef LINEAR INTER 
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else /* if (m_plnterpld) */ 

{ 

ulMaxBytes = m_ulInputBytesPerGran; 

} 

#endif 

PN_ASSERT (ulMaxBytes <= m_ulMaxBlockSize) ; 

} 

// //////////////////////////////////////////////////////////// 

/ 

// Mix n bytes of data into buffer 

ulNumBytesMixed = MixData (pSourceBuf f er , ulMaxBytes, bMonoToSte 
reoMayBeConverted) ; 



*/ 

/ 



{ 

Sample) 



if (ulNumBytesMixed > 0) 

{ 

: : fwrite (pSourceBuf f er, ulNumBytesMixed, 1, fdbefore) ; 

} 



// //////////////////////////////////////////////////////////// 

// If we need to resample , then do this and then mix data into 
// the player buffer. 

// Only resample and mix if volume is *not* zero and there 

// are some bytes to mix. 

if ( (m_pResampleId | | m_plnterpld) 

&& ulNumBytesMixed > 0 && m_u Volume > 0 && lm_bMute) 



Mixed; 



if (ulNumBytesMixed < ulMaxBytes && 8==m_AudioFmt . uBitsPer 

{ 

//fill remainder with 128 T s (-1), silence: 

UCHAR* pTmp = &pSourceBuf f er [ulNumBytesMixed] ; 

ULONG32 ulNumBytesLef tToSilence = ulMaxBytes-ulNumBytes 

do 
{ 

*pTmp = 12 8; 
pTmp++; 

} while ( - -ulNumBytesLef tToSilence) ; 

} 

BOOL bChannel Convert = FALSE; 
ULONG32 ulOutBytes = 0; 

if (m_pResampleId) 

{ 
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ulOutBytes = Resample ( (short* ) pSourceBuffer, 

ulMaxBytes, 

(short*) m_pResampleBuf , 
m_pResampleId, 
&bChannel Convert) ; 

// : : f write (m_pResampleBuf , ulOutBytes, 1, fdafter) ; 

/* Resampler will do stereo to mono conversion for us.* 

/ 

PN__ASSERT (ulMaxFramesOut == (ulOutBytes / 2 / 

(m_AudioFmt .uChannels == 2 && m_DeviceFmt . uChannels 
== 1 ? 1 : m_AudioFmt .uChannels) ) ) ; 

PN_ASSERT (m_bChannelConvert == bChannelConvert) ; 

} 

#ifdef L I NEAR_ I NTER 

else /* if (m_plnterpld) */ 

{ 

UINT32 ulSampleSize = m_AudioFmt . uChannels * 

(m_AudioFmt .uBitsPerSample == 16 



? 2 : 1) 
d *id) 



= = 1) 



#endif 



//Interp (short *inbuf, long insamps, short *outbuf, voi 

UINT32 ulOutSamples = Interp ( (short* ) pSourceBuffer, 

ulMaxBytes/ulSampleSi ze , 
(short*) tnjpResampleBuf , 
m_plnterpld) ; 

if (m_AudioFmt . uChannels == 2 && m_DeviceFmt . uChannels 

{ 

ulOutBytes = ulOutSamples * 

(m_DeviceFmt .uBitsPerSample == 16 ? 2 : 1) 

} 

else 

{ 

ulOutBytes = ulOutSamples * m_AudioFmt . uChannels * 
(m__DeviceFmt .uBitsPerSample == 16 ? 2 : 1) 

} 



if (m_bChannel Convert ) 
{ 

PN_ASSERT(m_pInterpId || ul0utBytes*2 ulBufSize) ; 
if ( ulOutBytes > ulBufSize/2 ) 
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ulOutBytes = ulBuf Size/2 ; 

} 

else 

PN__ASSERT(m_pInterpId || ulOutBytes <= ulBufSize); 
if ( ulOutBytes > ulBufSize ) 
ulOutBytes = ulBufSize; 

} 

CPNMixer: :MixBuffer( m_pResampleBuf , pPlayerBuf , 

ulOutBytes , m_bChannel Convert , 

m_u Volume, m_DeviceFmt .uBitsPerSample) 

} 

#ifdef _TESTING 

if ( g_log > 0 ) 

{ 

write ( g_log, pPlayerBuf, ulNumBytesMixed) ; 

} 

#endif 

/* This is for *FROM* stream */ 
if (bGetCrossFadeData) 

{ 

m_bFadeAl readyDone = TRUE; 

} 

/* If we are cross-fading, we have data from this stream in pPl 
ayerBuf 

* Now get data to be cross- faded from *From* stream in 

* m_pCrossFadeBuf f er 

*/ 

else if (bCrossFadeThisTime) 
{ 

/* Allocate CrossFade Buffer */ 
if ( !m_pCrossFadeBuf f er) 

{ 

m_ulCrossFadeBuff erSize = ulBufSize; 

m_pCrossFadeBuf f er = new UCHAR [m_ulCrossFadeBuff erSize] 

; 

} 

memset (m_pCrossFadeBuf f er , 0 , PN_SAFESIZE_T (m_ulCrossFadeBu 
f ferSize) ) ; 

UINT32 ulCrossFadeLen = m_ulCrossFadeBuff erSize ; 
UINT32 ulTmpBufTime = 0; 
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m_pCrossFadeStream->MixIntoBuf f er (m_pCrossFadeBuf f er , 

ulCrossFadeLen, ulTmpBufTi 

me, bCalledFromAudioThread, TRUE); 

/* Now it is time to perform cross-fading between 
* pPlayerBuf and m_pCrossFadeBuf f er 
*/ 

UINT32 ulStartByteToFade = 0; 

UINT32 ulNumMsInThisBuf fer = CalcDeviceMs (ulBuf Siz 

e) ; 

UINT32 ulNumBytesToBeCrossFaded = ulBufSize; 
UINT32 ulSampleSize = ( (m_DeviceFmt . uBitsPerSample==8) ? 1 : 



2) 



* m_DeviceFmt .uChannels; 

/* Make sure we have integral number of samples */ 

PN ASSERT (ulBuf Size == (ulBuf Size/ulSampleSize) * ulSampleS 



ize) 



/* Only partial buffer needs to be cross-faded. 



* 

* | 

* 

* 

* | | <-- Granularity size block that is mixed. 

* <--> Only partial block needs to be faded 
*/ 

if (ulTimeActuallyFaded < ulNumMsInThisBuf fer) 
{ 

UlNumBytesToBeCrossFaded = (UINT32) (ulBufSize * 

(ulTimeActuallyFaded*! . /ulNumMsInThisBuf fer) ) ; 

UINT32 ulOutOfPhase = ulNumBytesToBeCrossFaded % ulSamp 

leSize; 

if (ulOutOfPhase > 0) 
{ 

UlNumBytesToBeCrossFaded = 

UlNumBytesToBeCrossFaded - ulOutOfPhase; 

} 

ulStartByteToFade = ulBufSize - ulNumBytesToBeCrossFade 
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leSize; 



d; 

} 

if (ulTimeActuallyFaded > m__ulCrossFadeDuration) 
{ 

ulNumBytesToBeCrossFaded = (UINT32) (ulBufSize * 

(m_ulCrossFadeDuration*l . /ulNumMsInThisBuf f er) ) ; 

UINT32 ulOutOf Phase = ulNumBytesToBeCrossFaded % ulSamp 

if (ulOutOf Phase > 0) 

{ 

UlNumBytesToBeCrossFaded = 

UlNumBytesToBeCrossFaded - ulOutOf Phase; 

} 

} 

UINT16 uNumSamples = (UINT16) (ulNumBytesToBeCrossFaded/ 

ulSampleSize) ; 

m_pCrossFader->CrossFade ( (INT16*) (m__pCrossFadeBuf f er+ulSta 
rtByteToFade) , 

(INT16*) (pPlayerBuf +ulStartByteTo 

Fade) , 

uNumSamples) ; 

/* Mix the initial bytes that are not cross-faded*/ 
if (ulStartByteToFade > 0) 

{ 

CPNMixer: :MixBuf f er (m_pCrossFadeBuf f er, 

pPlayerBuf , 
ulStartByteToFade , 
FALSE, 
100, 

m_DeviceFmt . uBitsPerSample) ; 

} 

/* Mix the remaining bytes */ 

if (ulNumBytesToBeCrossFaded + ulStartByteToFade < ulBufSiz 



e) 

{ 

CPNMixer : :MixBuffer (m_pCrossFadeBuf f er + ulNumBytesToBe 
CrossFaded + ulStartByteToFade, 

pPlayerBuf + ulNumBytesToBeCrossFad 

ed + ulStartByteToFade, 

ulBufSize - (ulNumBytesToBeCrossFad 

ed + ulStartByteToFade) , 

FALSE, 
100, 
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m_DeviceFmt . uBitsPerSample) ; 

} 

} 

if (bGetCrossFadeData | | bCrossFadeThisTime) 
{ 

if (bGetCrossFadeData) 
{ 

PN_ASSERT (m_ulLastWriteTime >= m_ulCrossFadeStartTime) ; 
if (m_ulLastWriteTime >= m_ulCrossFadeSt art Time) 

{ 

ulTimeActuallyFaded = m_ulLastWriteTime - m_ulCross 

FadeStartTime; 

} 

} 

if (ulTimeActuallyFaded >= m__ulCrossFadeDuration) 

{ 

m_bCrossFadingToBeDone = FALSE; 
PN_RELEASE (m_pCrossFadeStream) ; 

/* We should release any extra buffers if it is a 
* *from* stream 
*/ 

if ( !m_bFadeToThisStream) 

{ 

/* Do not remove any instantaenous buffers */ 
FlushBuf fers (FALSE) ; 

} 

} 

else 

{ 

m_ulCrossFadeDuration -= ulTimeActuallyFaded; 
m_ulCrossFadeStartTime + = ulTimeActuallyFaded; 

} 

} 

else if (m_bCrossFadingToBeDone && ! m_bFadeToThisStream) 

{ 

m_pCrossFadeStream->SyncStream(m_ulLastWriteTime) ; 

} 

return PNR_OK; 

} 



/***************************************************************^ 
****** 

* Method: 
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* CPNAudioStream: :MixData 

* Purpose : 

* Mix all valid data in my auxilliary list into the buffer. 
* 

* Thoughts: 

* while there are buffers available 

* if (buffertime is more than endtime) break; 

* if (any part of buffer is >startime and < endtime) 

* we are in business. 

* mix that part of the buffer, update offset, 

* update max of num bytes written in this round. 

* Looks like we need to keep LastWrite time and offsets for al 



1 buffers 

* that get written in one pass. 

* Consider this scenario: 
★ 

* 



| -> Skew 1 
->Skew 2 5 



| _ | Skew in opposite di 

rection 3 



4 



<- Buffer to be mixed currently 



Order of buffer processing will be in the order of number 
s on the right . 

Since all the theree buffers have fudge within fudge limi 
t, they need to 

be written one after the other. This is possible only if 
we keep last 

write times and last written offsets in mixer buffer for 
each one of them. 

Is this extra processsing on every write worthed OR do we p 
lace limitations 

on the data that can be written. 

* Hmmm. . . We are now going with STREAMED/ INSTANTANEOUS/TIMED 
model since the 

* above case is shows that users can really screw things up a 
nd it would be 
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* very difficult to handle this case. So instead, we do not s 
upport over - 1 apped 

* buffers any more. i.e. If a renderer wants to have streamed 
and instantaneous 

* behavior, it needs to use two audio streams. 

*/ 

ULONG32 CPNAudioStream: :MixData 

( 

UCHAR* pDestBuf 

ULONG32 ulBufLen 
, BOOL bMonoToStereoMayBeConverted 

) 
{ 



PNAudioInfo* plnfo = 0; 

ULONG32 ulNumBytes = 0 ; 

LISTPOSITION lp = 0; 

LISTPOSITION lastlp , = 0 ; 

ULONG32 ulNumBytesWritten = 0; 

BOOL bLastWriteTimeToBeUpdated = TRUE; 



// //////////////////////////////////////////////////////////// 

/ 

// Go thru the buffer list and mix in valid buffers. 

/* First all instantaneous buffers 

* All the instantaneous buffers get written at the start of 

* the destination buffer. 
*/ 

lp = lastlp = 0 ; 

lp = mj?InstantaneousList->GetHeadPosition ( ) ; 
while ( lp ) 

{ 

lastlp = lp; 

plnfo = (PNAudioInfo*) m_pInstantaneousList->GetNext (lp) ; 

ulNumBytes = plnfo- >ulBytesLeft > ulBufLen ? 

ulBufLen : plnfo- >ulBytesLeft ; 

// //////////////////////////////////////////////////////// 

///// 

// Mix the data into the stream buffer, with stream volume. 

Don't 

// do volume calculation if volume is 1. If volume is 0, th 

en 

// don't mix. Don't mix if there are no bytes to mix. 
if ( m uVolume > 1 && ulNumBytes > 0 ) 
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{ 

CPNMixer : :MixBuf f er ( plnf o- >pOf f set , pDestBuf, 

ulNumBytes, m_bChannel Convert && b 

MonoToStereoMayBeConverted, 

m_u Volume , m_AudioFmt . uBitsPerSamp 

le ) ; 

} 

ULONG32 ulActualBytesWritten = ( (m_bChannelConvert && bMono 
ToStereoMayBeConverted) ? 

2*ulNumBytes : ulNumBytes) ; 
if (ulNumBytesWritten < ulActualBytesWritten) 

{ 

ulNumBytesWritten = ulActualBytesWritten; 

} 

plnf o->ulBytesLef t -= ulNumBytes; 
plnf o->pOff set += ulNumBytes; 

if (plnf o->ulBytesLef t == 0) 

{ 

plnf o->pBuf f er->Release () ; 
delete plnfo; 

m_pInstantaneousList->RemoveAt (lastlp) ; 

} 

} 

/* now timed buffers */ 

/* We do not support over-lapped buffers any more */ , 
ULONG32 ulDestinationOf f set = 0; 
UINT32 ulNumlnBytesWritten = 0; 
lp = lastlp = 0; 

lp = m_pDataList->GetHeadPosition() ; 
while ( lp ) 

{ 

lastlp = lp; 

plnfo = (PNAudioInf o*) m_pDataList->GetNext (lp) ; 

/* only at the start of the buffer, we check whether 
* we are done or not for this round 
*/ 

if (plnfo- >uAudioStreamType == S TRE AM I NG_AUD I O && 
plnfo->p0f f set == pInfo->pBuf fer->GetBuf fer () && 
plnf o->ulStartTime > m__ulLastWriteTime && 
plnf o->ulStartTime - m_ulLastWriteTime > m_ulFudge) 

{ 

break; 
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} 

if (pInfo->uAudioStreamType == TIMED_AUDIO && 

(pInfo->ulBytesLef t == plnf o->pBuf f er- >GetSize ( ) || 
m_bCrossFadingToBeDone) ) 

{ 

UINT32 ulStartTime = plnf o- >ulStartTime + 

CalcMs (plnf o->pBuf f er->GetSize ( ) - 
plnf o->ulBytesLef t ) ; 

if (ulStartTime >= m_ulLastWriteTime && 

ulStartTime - m_ulLastWriteTime >= m_ulGranularity) 

{ 

break; 

} 

/*Calculate the actual time where to write from*/ 

ULONG32 ulBytesDiff = 0; 

if (ulStartTime >= m_ulLastWriteTime) 

{ 

ulBytesDiff = CalcOf f set (m_ulLastWriteTime , ulStart 

Time) ; 

ulBytesDiff = ulBytesDiff - (ulBytesDiff % (2*m_Aud 
ioFmt . uChanriels) ) ; 



d) 



kets . 
a row, 
flag 

ten 

n*2) 



t)/2) ; 



if (m_bChannel Convert && bMonoToStereoMayBeConverte 
{ 

ulBytesDiff *= 2; 

/* This check is needed to account for lost pac 

* If there are more than one packet missing in 

* we may get multiple packets with T I MED_AUD I O 

* and they may be far apart in time to be writ 

* in this block 
*/ 

if (ulDestinationOf f set + ulBytesDiff > ulBufLe 



bLastWriteTimeToBeUpdated = FALSE; 
m_ulLastWriteTime += 

CalcMs ( (ulBufLen*2 - ulDestinationOf fse 

break; 
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kets . 

a row, 

flag 
ten 

n) 



Time) 



} 

else 

{ 



} 



/* This check is needed to account for lost pac 

* If there are more than one packet missing in 

* we may get multiple packets with T I MED_AUD I 0 

* and they may be far apart in time to be writ 

* in this block 
*/ 

if (ulDestinationOf f set + ulBytesDiff > ulBufLe 



bLastWriteTimeToBeUpdated = FALSE; 
m_ulLastWriteTime += 

CalcMs (ulBufLen - ulDestinationOf f set ) ; 
break; 



} 



} 

else 

{ 



ulDestinationOf f set += ulBytesDiff; 



ulBytesDiff = CalcOf f set (ulStartTime , m_ulLastWrite 



/* Make sure that it is at even byte boundary */ 
ulBytesDiff = ulBytesDiff - (ulBytesDiff % (2*m 

_AudioFmt . uChannels) ) ; 

if (plnf o->ulBytesLef t >= ulBytesDiff) 



{ 



} 

else 

{ 



plnf o->pOff set += ulBytesDiff; 

pInfo->ulBytesLef t -= ulBytesDiff; 



plnf o- >pOff set 
plnf o- >ulBytesLef t 



+= plnf o->ulBytesLef t ; 
= 0; 



} 

/* just place it at the end of the last write position */ 
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)/2; 



///// 

Don 1 1 
en 



ufLen*2) 



ULONG32 ulNumMoreBytesToWrite = 0; 

if (mJoChannel Convert && bMonoToStereoMayBeConverted) 

{ 

ulNumMoreBytesToWrite = (ulBuf Len*2 -ulDestinationOf f set 

} 

else 

{ 

ulNumMoreBytesToWrite = ulBuf Len-ulDestinationOf f set ; 

} 

ulNumBytes = plnf o- >ulBytesLef t > ulNumMoreBytesToWrite ? 

ulNumMoreBytesToWrite : plnf o->ulBytesLef t ; 

// //////////////////////////////////////////////////////// 

// Mix the data into the stream buffer, with stream volume. 

// do volume calculation if volume is 1. If volume is 0, th 

// don't mix. Don't mix if there are no bytes to mix. 
if (m_uVolume > 1 && ulNumBytes > 0) 

{ 

if (m_bChannel Convert && bMonoToStereoMayBeConverted) 

{ 

PN_ASSERT (ulDestinationOf f set + ulNumBytes*2 <= ulB 

} 

else 

{ 

PN__ASSERT (ulDestinationOf f set + ulNumBytes <= ulBuf 

} 

CPNMixer : : MixBuf f er (plnf o- >pOff set , pDestBuf +ulDest inat 

ulNumBytes, m_bChannel Convert && b 
m_uVolume , m_AudioFmt . uBitsPerSamp 

} 



Len) ; 



ionOf f set , 

MonoToStereoMayBeConverted, 
le) ; 



ULONG32 ulActuallyBytesWritten = ulNumBytes; 

ulActuallyBytesWritten = ( (m_bChannel Convert bMonoToSter 
eoMayBe Conve r t e d ) ? 

ulActuallyBytesWritten*2 : ulActuallyBytesWritten) ; 
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if (ulNumBytesWritten < ulActuallyBytesWritten + ulDestinat 
ionOf f set) 

{ 

ulNumBytesWritten = ulActuallyBytesWritten + ulDestinat 

ionOf f set ; 

} 

ulDestinationOf f set += ulActuallyBytesWritten; 

pInfo->ulBytesLef t -= ulNumBytes; 
plnfo->p0f f set += ulNumBytes; 

ulNumlnBytesWritten += ulNumBytes; 

ULONG32 ulLastWriteTime = plnf o- >ulStartTime + 

CalcMs (pInfo->pBuf fer->GetSize () - pInfo->u 

lBytesLeft) ; 

if (bLastWriteTimeToBeUpdated) 

{ 

m_ulLastStartTimePlayed = ulLastWriteTime - CalcMs (ulNu 

mBytes) ; 

} 

bLastWriteTimeToBeUpdated = FALSE ; 

if (m_ulLastWriteTime < ulLastWriteTime) 

{ 

m_ulLastWriteTime = ulLastWriteTime; 

} 

if (pInfo->ulBytesLef t == 0) 

{ 

plnf o- >pBuf f er- >Release ( ) ; 
delete plnfo; 

m_pDataList->RemoveAt (lastlp) ; 

} 

/* Have we written enough for this time? */ 
if (ulBufLen == ulDestinationOf f set | | 

(m_bChannelConvert && bMonoToStereoMayBeConverted 

(ulBufLen*2 == ulDestinationOf f set ) ) ) 

{ 

break; 

} 

} 

if (bLastWriteTimeToBeUpdated) 

{ 
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m_ulLastWriteTime += m_ulGranularity ; 

else /* We mixed some input bytes */ 
{ 

m_ulLastEndTimePlayed = m_ulLastStartTimePlayed + 

CalcMs (ulNumlnBytesWritten) ; 

if (m_bRealAudioStream) 

//{FILE* fl = : :fopen( "c: \\tempWrasync.txt " , "a+"); : : fprintf (f 1, 
"Call MapFudgedTimestamps : %lu\n" , m_ulLastStartTimePlayed) ; : rfclos 
e(fl) ;} 

MapFudgedTimestamps () ; 

} 

} 

return ulNumBytesWritten; 

} 

/************************** **************************************** 
****** 

* Method: 

* CPNAudioStream: : CalcMs 

* Purpose : 

* Calculate the duration in millisecs for this number 
of bytes. 

*/ 

ULONG32 CPNAudioStream: : CalcMs 

( 

UL0NG32 ulNumBytes 

) 
{ 

return ( (ULONG32) (( 1000.0 

/ (m_AudioFmt .uChannels * ( (m_AudioFmt . uBitsPerSamp 

le==8)?l:2) 

* m_AudioFmt . ulSamplesPerSec) ) 

* ulNumBytes) ) ; 

} 

/****************************************************************** 
****** 

* Method: 

* CPNAudioStream: : CalcDeviceMs 

* Purpose : 

* Calculate the duration in millisecs for this number 
of 

* bytes in Device format. 
*/ 
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ULONG32 CPNAudioStream: : CalcDeviceMs 
( 

ULONG 32 u 1 NumBy t e s 

) 
{ 

return ( (ULONG32) (( 1000.0 

/ (m_DeviceFmt . uChannels * ( (m_DeviceFmt . uBitsPerSa 

mple==8) ?1:2) 

* m_DeviceFmt . ulSamplesPerSec) ) 

* ulNumBytes) ) ; 

} 

/************************* ***************************************** 
****** 

* Method: 

* CPNAudioStream: :CalcOffset 

* Purpose : 

* Calculate the offset in bytes given time. 
*/ 

ULONG 3 2 CPNAudioStream: :CalcOffset 

( 

ULONG 3 2 ulStartTime 
ULONG 3 2 ulEndTime 

) 
{ 

/* Using m_ulBytesPerMs may introduce cumulative error due 

* to decimal cutoff 
*/ 

return (ULONG32) ( (ulEndTime - ulStartTime) * 

(m_ulGranularity ? m_ulInputBytesPerGran*l . /m 

_ulGranularity : 0) ) ; 

} 

void CPNAudioStream: : FlushBuffers (BOOL blnstantaneousAlso) 

{ 

if ( m_pDataList ) 

{ 

PNAudioInfo* plnfo = 0; 

CPNSimpleList :: Iterator liter = m_pDataList->Begin () ; 
for ( ; liter != m_pDataList- >End ( ) ; ++llter) 

{ 

plnfo = (PNAudioInfo*) (*llter) ; 
if ( plnfo ) 

{ 

pInfo->pBuf fer->Release () ; 
delete plnfo; 
plnfo = 0; 
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0 



} 

} 

m_pDataList- >RemoveAll () ; 

} 

if ( m_jpInstantaneousList && blnstantaneousAlso) 

{ 

PNAudioInf o* plnf o = 0 ; 

CPNSimpleList :: Iterator liter = m_pInstantaneousList->Begin 
for (; liter != m_pInstantaneousList->End ( ) ; ++llter) 

{ 

plnfo = ( PNAudioInf o*) (*llter) ; 

if ( plnfo ) 

{ 

plnf o->pBuf f er->Release ( ) ; 
delete plnfo; 
plnfo = 0; 

} 

.} 

m_pInstantaneousList->RemoveAll () ; 



BOOL 

CPNAudioStream: : EnoughDataAvailable (ULONG32& ulLastWriteTime , ULONG 
32 & ulNumMsRequired) 

{ 

ULONG32 ulBytesNeeded = 0 ; 
BOOL bAvailable = TRUE; 

// //////////////////////////////////////////////////////// 

///// 

// If no resampling, mix stream data directly into the player 
// buffer. 

if ( !m_pResampleId ) 
{ 

ulBytesNeeded = m_ulInputBytesPerGran; 

} 

// //////////////////////////////////////////////////////////// 



/ 



// If resampling, mix stream data into a tmp buffer. Then 

// resample this buffer and mix the final resampled buffer into 

// the player buffer. 

else 

{ 

/* 

* Audio Session will always ask for m_ulOutputBytesPerGran 
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bytes to be mixed 

* in MixIntoBuf fer () call. So we need to produce these man 
y number of bytes. 

* If there is any mono-stereo conversion that happens in t 
he mixing, number 

* of output bytes required from the resampler are half the 
number of 

* m_ulOutputBytesPerGran bytes. 

*/ 

ULONG32 ulMaxFramesOut = m_ulOutputBytesPerGran/ (m_DeviceFm 
t .uBitsPerSample==8 ? 1 : 2) ; 

if (m_AudioFmt .uChannels == 2 | | m_DeviceFmt .uChannels == 2 

) 

{ 

ulMaxFramesOut /= 2 ; 

} 

ULONG32 ulMaxFramesIn = ResamplerRequires (ulMaxFramesOut , m 
_pResampleId) ; 

ulBytesNeeded = ulMaxFramesIn * ( (m_AudioFmt . uBitsPerSampl 
e==8) ? 1 : 2) 

* rn_AudioFmt . uChannels ; 

} 

ULONG32 ulBytesAvailable = 0 ; 

LISTPOSITION lp = m_pDataList->GetHeadPosit 

ion () ; 

while (lp) 

{ 

PNAudioInfo* plnfo = (PNAudioInf o*) m_pDataList->GetNext (1 



P) ; 



ulBytesAvailable += plnf o->ulBytesLef t ; 
if (ulBytesAvailable >= ulBytesNeeded) 

{ 

return TRUE; 

} 

} 

ulNumMsRequired = CalcMs (ulBytesNeeded - ulBytesAvailable); 

PN ASSERT (m ulLastWriteTime + m_ulGranularity >= ulNumMsRequire 



d) ; 
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if (m_ulLastWriteTime + m_ulGranularity >= ulNumMsRequired) 

{ 

ulLastWriteTime = m_ulLastWriteTime + m_ulGranularity - ulN 
umMsRequi red ; 

} 

else 

{ 

ulLastWriteTime = 0; 

} 

return FALSE; 

} 



void 

CPNAudioStream: : SetLive (BOOL blsLive) 

{ 

if (m_bl sFirs t Packet ) 

{ 

m_bIsLive = blsLive; 

} 

} 

PN_RESULT 

CPNAudioStream: : StartCrossFade (CPNAudioStream* pFromStream, 

UINT32 ulCrossFadeStartTim 

e, 

UINT32 ulCrossFadeDuration 
BOOL bToStream) 

{ 

if (m_bCrossFadingToBeDone) 

{ 

return PNR__UNEXPECTED ; 

. } 

PN_RELEASE (m__pCrossFadeStream) ; 

m_bCrossFadingToBeDone = TRUE; 
m_j?CrossFadeStream = pFromStream; 

m_pCrossFadeStream->AddRef () ; 

m_ulCrossFadeStartTime = ulCrossFadeStartTime ; 
m_ulCrossFadeDuration = ulCrossFadeDuration; 
m_bFadeToThisStream = bToStream; 

if (m_blnited && m_bFadeToThisStream) 

{ 
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InitializeCrossFader ( ) ; 

} 

return PNR_0K; 

} 

void 

CPNAudioStream: : InitializeCrossFader (void) 

{ 

if ( !m_pCrossFader) 

{ 

m_pCrossFader = new CrossFader; 

} 

UINT16 uNumSamplesToFade = (UINT16) 

(m_DeviceFmt .ulSamplesPerSec * m_ulCrossFadeDuration/lOOO) ; 

/* Make cross- fade duration to land on a sample boundary */ 
m_ulCrossFadeDuration = (uNumSamplesToFade * 1000)/ 

m_DeviceFmt . ulSamplesPerSec ; 

PN_ASSERT (m_ulCrossFadeDuration > 0 && uNumSamplesToFade > 0) ; 

m_pCrossFader-> Initialize (uNumSamplesToFade, m_DeviceFmt . uChann 
els) ; 

} 
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revision 1.94 

date: 1998/ 18:57:22; author: rahul; state: Exp; lines: +73 -2 
branches: 1.94.2; 

Fixed occasioncal static during cross-fade. 

We were not chopping off the data from the To stream at sample boundary. 
Fixed wierd sample rate logic to match the closest supported sample rate. 



revision 1.86 

date: 1998/; author: rahul; state: Exp; lines: +4 -2 
Bug fix for cross-fade. 



revision 1.85 

date: 1998/; author: henry; state: Exp; lines: +26 -8 
More fixes for audio cross-fade (Rahul) 



revision 1.84 

date: 1998/; author: rahul; state: Exp; lines: +252 -93 
CrossFade is now functional! 



revision 1.80 

date: 1998/; author: rahul; state: Exp; lines: +42 -20 
Code complete on Cross-Fader. Need to be tested once RealAudio renderer 
starts using it. 



revision 1.77 

date: 1998/07:47:07; author: rahul; state: Exp; lines: +194 -9 

Plumming for Cross-Fade support complete. 

Need to change one function to add an efficient cross-fader. 



revision 1.76 

date: 1998/ 05:53:23; author: rahul; state: Exp; lines: +35 -45 
More setup for cross fade. 



